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Abstract 

We provide a local convergence analysis of Gauss- Newton method for solving overdetermined 
nonlinear systems of equations under a majorant condition. Without convexity hypothesis on 
the derivative of the majorant function, we obtain that the method is well-defined and converges 
with superlinear rate. Moreover, we also obtain optimal convergence radius, the biggest range 
for uniqueness of the solution along with some other special cases. 

Keywords: Overdetermined nonlinear systems of equations; Gauss-Newton method; Majorant 
condition; Local convergence. 

1 Introduction 

In this work, we study Gauss-Newton method to solve overdetermined nonlinear systems of equa- 
tions 

F(x) = 0, (1) 

where F : f2 — > Y be a continuously differentiable function, such that F'{x) is injective and has a 
closed image in the open set OCX, and X and Y are Hilbert spaces. If X = R n and Y = M m , then 
the number of unknowns are not larger than the number of equations, since F'{x) is injective. 

When F'{x) is invertible, Newton method is the most efficient method known for finds solutions 
of (UJ). However, when F'(x) is not necessarily invertible, a generalized Newton method, called the 
Gauss-Newton method, defined by 

x k+l =x k - [F'(x k )*F'(x k )] - 1 F'{x k )*F(x k ), k = 0, 1, . . . , 
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where A* denotes the adjoint of the operator A, finds least squares solutions of (H|) which may 
be or not solutions of (P). These least squares solutions are related to the nonlinear least squares 
problem 

mm ||F(x)|| 2 . (2) 

We will consider the case where the solution x* of ([2]) also satisfies ([T]) . In the theory of nonlinear 
least squares problems, this case is called the zero-residual case. 

Regarding the local and semi-local convergence analysis of Newton and Gauss-Newton methods, 
in the last years there have been much work attempting to alleviate the assumption of Lipschitz 
continuity on operator F' , see for example [IJElElElElllZllSlElliniinilEllISllI^- The main 
conditions that relaxes the Lipschitz continuity on the derivative is the majorant condition, used 
for example EJ [Tj EJ E] , and the generalized Lipschitz condition due to X.Wang, used for example 
in [21 O [lOl HH [161 EJ- I n f ac t) as proved in [6] if the majorant function has convex derivative, 
then these conditions are equivalent, otherwise, the Wang's condition can be seen as a particular 
case of the majorant condition. Moreover, the majorant formulation provides a clear relationship 
between the majorant function and the nonlinear operator under consideration, simplifying the 
proof of convergence substantially. 

Our aim in this paper is to present a new local convergence analysis of Gauss-Newton method 
for solving (pQ) under a majorant condition. Without convexity hypothesis on the derivative of the 
majorant function, hypothesis assumed in [8], we obtain convergence, uniqueness, superlinear rate 
and estimative of the best possible convergence radius. In addition to the special cases obtained 
in [8], we also obtain results under Holder-Like and generalized Lipschitz conditions. In the latter 
case, the results are obtained without any assumptions of nondecreasing of the function that defines 
the condition, thus generalizing Corollary 6.3 in [3]. It is worth mentioning out that similarly to 
the convergence analysis of the Newton method (see [6]), the hypothesis of convex derivative of the 
majorant function or nondecreasing of the function which define the generalized Lipschitz condition, 
is needed only to obtain quadratic convergence rate. 

The organization of the paper is as follows. In Section II. 1\ we list some notations in our 
presentation. In Section [2] we state the main result, and in Section 12.11 some properties involving 
the majorant function are established. In Section 12.21 we present the relationships between the 
majorant function and the non-linear function F; in Section 12.31 the optimal ball of convergence 
and the uniqueness of the stationary point are established. In Section 12.41 our main result is proven 
and, finally, some applications of this result are presented in Section [3l 

1.1 Notation and auxiliary results 

The following notations and results are used throughout our presentation. Let X and Y be Hilbert 
spaces. The open and closed ball at a 6 X and radius 5 > are denoted, respectively by 

B(a, 5) := {x 6 X; \\x — a\\ < 5}, B[a, 5] := {x G X; \\x — a\\ ^ 5}. 
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Let A : X — > Y be a continuous and injective linear operator with closed image in f2. The Moore- 
Penrose inverse, At : Y X, of A is defined by 

A f := (i^A)- 1 ^, 

where A* denotes the adjoint of the linear operator A. 

2 Local analysis for the Gauss-Newton method 

Our goal is to state and prove a local theorem for the Gauss-Newton method, which generalizes 
Corollary 8 of [8], as well as Theorem 2 of [6]. First, we prove some results regarding the scalar 
majorant function, which relaxes the lipschitz condition. Then we establish the main relationships 
between the majorant function and the nonlinear function F. We also obtain the optimal ball 
of convergence and the uniqueness of the solution in a suitable region. Finally, we show well 
definedness and convergence of the Gauss-Newton method, along with results on the convergence 
rates. The statement of the theorem is: 

Theorem 1. Let X and Y be Hilbert spaces, SI CI be an open set and F : Q — > Y be a continuously 
differentiate function such that F' has a closed image in Q. Let x* G f2, R > and (5 := \\F'(x*)^\\, 
k := sup{t G [0, R) : B{x if ,t) C £1} . Suppose that F(x*) = 0, F'(x*) is injective and there exists a 
f : [0, R) — > R continuously differentiate such that 

\\F'(x) - F'(x* + t(x - x*))\\ < f (\\x - x,\\) - f (t\\x - x,\\) , (3) 

for all t G [0, 1], x G B(x*, k) and 

hi) /(0) = and f (0) = -1; 

h2) /' is strictly increasing. 

Let positive constants, v := sup {t G [0, R) : 1 — (3[f'(t) + 1] > 0} , 

p := sup Id G (0, v) : ^I^zML < i, t e (0 , 5 )|, r:=min{ N p} 

6e given. Then the sequences with starting points xq G B(x*, r)/{x*} and to = ll^o — respec- 
tively, namely 

T?i( \\t?( \ 4- P[tkf'(tk) — f(tk)] 7 n 1 (A\ 

x k+1 = x k - F (x k yF {x k , t k+ i = — — r—rr , k = 0,1,..., 4 

l-p(/'(**) + !) 

are we// defined; {t k } is strictly decreasing, is contained in (0, r) and converges to 0. Furthermore, 
{x k } is contained in B(x*,r) and converges to the point x* ; which is the unique zero of F in 
B(x*,a), where a := sup{t G (0, /c) : f3[f(t)/t + 1] < 1} and there hold: 

lim [||xfc+i - /\\x k - x*\\] = 0, lim [t k+1 /t k ] = 0. (5) 

k— ¥oo k— >oo 
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Moreover, if [f3(pf'(p) — /(p))]/[p(l — [3(f'(p) + 1))] = 1 and p < k, then r = p is the best possible 

convergence radius. 

If, additionally, given < p < 1 

h3) the function (0, v) 3 t \- > [tf'(t)—f(t)]/t p+1 is strictly increasing, then the sequence {tk+i/t^ +1 } 
is strictly decreasing and we have: 

< [tk+i/t p k +1 ] \\x k -x*\\ p+1 < [h/t p Q +1 ] \\ Xk - Xif \\P+\ k = 0,l,... . (6) 

Consequently, for k > 0, 



I 1 1 ^ 



io[tiAo] fc , if P=0; 

io[*iAo] {(p+1)fc - 1)/p , if P^O. 



Remark 1. When F'(x*) is invertible, Theorem^ is similar to the result on Newton method for 
solving nonlinear systems of equations, obtained by Ferreira in Theorem 2 of f^/. 

Remark 2. In J3J/ was present a local convergence analysis of Newton method for solving nonlinear 
systems of equations under a majorant conditon with quadratic rate, where the additional hypothe- 
ses that the majorant function, f, has convex derivative has been imposed. However, as observed 
in Jfijl, this additional hypotheses, was necessary only in order to obtain quadratic convergence rate, 
since without the convexity of f , the sequence gernerated by the method, continues to converge, 
but with superlinear rate only, cf. Theorem 2 in fdjj. Now, regarding the Gauss-Newton method, 
the same characteristics are observed, i.e., the convexity of f is necessary only to obtain quadratic 
convergence rate, since the first inequality in ([5|), implies that the convergence rate is superlinear, 
however using the convexity of f , it was proved that the convergence rate is quadratic, see Corol- 
lary 8 in J2J/. Moreover, when f is convex we can prove that h3 holds with p = 1, which gives the 
results in JE/. 

From now on, we assume that all the assumptions of Theorem [1] hold, with the exception of h3, 
which will be considered to hold only when explicitly stated. 



2.1 The scalar sequences 

Our first goal is to show that the constant, k, associated with Q and the constants v, p and a 
associated with the majorant function /, are positive. Afterwards, we prove the statements in 
Theorem [T] involving { t k } • 

Proposition 2. The constants k, v and a are positive and we have: 

i) 1 - 0(/'(t) + 1) > 0, Vt€(0,i/); 

ii) tf'(t)-f(t)>0, Vt€(0,i/); 
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iii) P[f(t)/t + l] < 1, Vi G (0,a) 



Proof. Since O is an open set and G immediately we may conclude, that k > 0. Now, as /' 
is continuous in (0, R) and /'(0) = —1, it is easily seen that 

lim [1 - P(f'(t) + 1)] = 1. 

i->0 

Thus, there exists a 5 > such that [1 - f3(f'(t) + 1)] > for all t € (0,5). Hence, 5 < v, which 
proves that v > 0. Condition hi implies that 



lim /? 
t-»o 



/(*) 



t 



+ 1 



lim /3 



/(*) " /(0) 



t-0 



/'(0) 



0. 



Thus, there exists a 5 > such that f3[f(t)/t + 1] < 1 for all t G (0,5). So: 5 < cr, which proves 
that cr > 0. 

To establish item i use h2 and definition of v. 

Assumption (h2) implies that / is strictly convex. Hence, using hi we obtain 

= /(0) >/(*) + f(t)(0-t), Vt€(0,i/). 

which is equivalent to item ii. 

Again the hypotheses h2 implies that / is strictly convex. Hence, as /(0) = we have f(t)/t = 
[f(t) — f(0)]/t, so that using the convexity properties gives that f(t)/t is increasing. Therefore, 
combining the definition of a and the fact that f(t)/t is increasing, item iii follows. □ 

Proposition [2] guarantees, in particular, that 1 — f3(f'(t) + 1) > for all t G [0, v). Therefore, 
the following iteration map for /, is well defined in [0, v). Denoting this by gf\ 



9f ■ [0, 



t H- 



[0, +oo) 

l-/3(/'(i)+l) • 



(7) 



Proposition 3. limt_>o [<?/(*) A] = 0. Consequently, p > and < <?/(i) <t for all t G (0, p). 
Proof. First, using ([7D, hi followed by some algebraic manipulation, show 

\ m nor 

9f m- Mw-m 



t-0 



t[l-P(f>(t) + l)} 



(8) 



As /'(0) = —1, it follows from the last equality that limt_>o = 0- 

Now, using the first statement we have that there exists 5 G (0, u), such that [gf(t)/t] < 1, for 
all t G (0, 5), which using the first equality in (jHJ) proves the positiveness of p. 

In order to conclude the proof, use the definition of p, items i and ii of the Proposition [5] and 
the first equality in (J5J). □ 
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Using (J7J), it is easily seen that the sequence is equivalently defined as 



*o = \\xo - t k+1 =g f (t k ), A; = 0,1,.... (9) 

Corollary 4. The sequence is well defined, strictly decreasing and contained in (0, p). More- 
over, {tk} converges superlinearly to 0, i.e., ]imk-too[tk+i/tk] = 0- If> additionally, h3 holds then 
the sequence {tk+i/t^ 1 } is strictly decreasing. 

Proof. As < to = \\%q — x*\\ < r < p, using last part of Proposition [3] and Q, we easily conclude 
that {tk} is well defined, is strictly decreasing and is contained in (0,p). So, we have proved the 
first statement of the corollary. 

Since {t^} C (0, p) is strictly decreasing, it converges. So, lim^oo i& = t* with < i* < p. 
Thus, the continuity of gj in [0, p) and ([9]) implies < i* = <?/(£*). But, if i* 7^ then Proposition [3] 
implies <7/(i*) < i*, hence = = lim^oo ^. Now, using the definition of {tf.} in ([9]) and the first 
statement in Proposition El we have ]hnk->oc[tk+i/tk] = \\m-k^oo[gf{tk)/tk\ = 0, thus proving the 
second statement. 

Since /' is strictly increasing in [0, R), then so is the function [0, v) B 1 1— > 1/[1 — f3(f'(t) + 1)], 
which combined with h3, Proposition [2] and ([7]), give that g f (t)/t p+1 is strictly increasing. Hence, 
using ([9]) and that is strictly decreasing, the last statement of the corollary follows. □ 

2.2 Relationship of the majorant function with the non-linear function 

In this section we present the main relationships between the majorant function, /, and the non- 
linear function, F. 

Lemma 5. If \\x — x*\\ < min{z^, k}, then F'(x)*F'(x) is invertible and it holds that 



<i WJTnT- uVT-n> F'(x)*-F'(x^ 



< v^/3 2 [/ / (||x-x.||) + l] 



i-p[f>(\\x-x4) + iy w y i-(3[f(\\x-x4) + iy 

In particular, F'(x)*F'(x) is invertible in B(x*,r). 

Proof. Neither assumption h3, nor the fact that the derivative of the majorant function is convex, 
is necessary for proving this lemma. The proof follows the same pattern as the proof of Lemma 13 
of 0. □ 

Now, it is convenient to study the linearization error of F at point in 0, for that we define 

E F (x,y):=F(y)-[F(x)+F'(x)(y-x)], y,xefl. (10) 

We will bound this error by the error in the linearization on the majorant function /: 

e f (t,u):=f(u)-[f(t) + f'(t)(u-t)}, t,ue[0,R). (11) 
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Lemma 6. If \\x — x*|| < n, then we may state \\Ep(x, x*)|| < (||x — x*||, 0). 

Proof. Neither assumption h3 nor the fact that the derivative of the majorant function is convex 
are necessary for proving this lemma. The proof follows the same pattern as the proof of Lemma 14 
of [8]. □ 

In particular, Lemma [5] guarantees that F'(x)*F'(x) is invertible in B(x*,r) and consequently, 
the Gauss-Newton iteration map is well-defined. Denoting by Gf, the Gauss- Newton iteration map 
for F in that region: 

G F :B(x*,r) — >■ Y 

x ^ x- F'{x)^F{x). K ' 

We now establish an important relationship between the maps gf and Gp- Consequently, we obtain 
that B(x Sf ,r) is invariant under Gf. This result will be of considerable important, when we later 
in this paper will assert the well definition of the Gauss- Newton method. 

Lemma 7. // ||x — x*|| < r, then \\Gf(x) — x*|| < g/(||x — x*||). Consequently, 

G F {B(x*,r)) C B(x*,r). 

Proof. The first inequality is trivial for x = x*, since F'(x^F(x*) = 0. Now assume that < 
||x — < r. Lemma [5] implies that F'(x)*F'(x) is invertible. Hence, using F{x if ) = 0, some 
algebraic manipulation and (|12p . we may establish 



G F (x) - x, = F'(x) t [F'(x)(x - x,) - F(x) + F(x m )]. 
From the last inequality, (|10p and Lemmas [5] and [6] we obtain 

\\G F (x) - x4 < ||F'(x)t|||| J B F (x,x,)|| < Pe f (\\x - x,||,0)/[l - (3(f'(\\x - x»||) + 1)]. 
Now, using (jlip and hi, we conclude from the last inequality that 

/?[/'(||x-x*||)||x-x*||-/(||x-x*||)] 



||G F (x)-x*|| < 



l-P(f'(\\x-x4) + l) 



which by (|7j), proves the first inequality of the lemma. 

Take x S £?(x*,r). Since < ||x — x*|| < r < p, the first inequality of the lemma and last 
inequality of Proposition [31 implies ||Gj?(x) — x*|| < 5/(||x — x*||) < \\x — x*|| and the last result 
follows. □ 

Lemma 8. // h3 holds and \\x — x*|| < t < r then \\Gf(x) — x*|| < [g/{t)/t p+1 ] \\x — x*|| p+1 . 

Proof. The inequality is trivial for x = x*. Now, since /' is strictly increasing in [0, R), then 
so is the function [0, v) 3 t \— > 1/[1 — f3(f'(t) + 1)], which combined with h3, Proposition [2] 
and (J7]) give that gf(t)/t p+1 is strictly increasing. Hence, using < ||x — x*|| < t we obtain 
g/(||x — x*||)/||x — x*|| p+1 < gf(t)/t p+1 . So, using Lemma[7]the statement follows. □ 
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2.3 Optimal ball of convergence and uniqueness 

In this section, we obtain the optimal convergence radius and the uniqueness of the solution. 

Lemma 9. If (3(pf'(p) — f(p))/p(l — f3(f'(p) + 1)) = 1 and p < k, then r = p is the best possible. 

Proof. Neither assumption (h3) nor the fact that the derivative of the majorant function is convex, 
is necessary for proving this lemma. The proof follows the same pattern as the proof of Lemma 16 
of [8]. □ 

Lemma 10. The point x*, is the unique zero of F in B(x*,a). 

Proof. Assume that y £ B{x if , a) and F{y) = 0. Using F(x*) = and F(y) = we have 

y-x*= F'(x^[F'{x*)(y - x„) - F(y) + F(x*)]. 
Combining the last equation with properties of the norm and the definition of /3, we obtain 

\\y — x*\\ < /3 / \\F'(x*) — F'(x* +u(y — x*))\\\\y — x*\\du. 
Jo 

Using ([3]) with x = x* + u{y — x*) and r = and some algebraic manipulation, we easily conclude 
from the last equality, that 



V-x4<0 [f(u\\y - x,\\) - f'(0)]\\y - x*\\du < (3 



o 



f{\\y - 

|| 2/ - x m \ 



+ 1 



\y - x* 



Since < \\y — x* \\ < a, using the item iii of the Proposition [21 we have \\y — x*\\ < \\y — x*||, which 
is a contradiction. Hence, y = x*. □ 

2.4 Gauss-Newton's sequence 

In this section, we prove the statements in Theorem [1] involving the Gauss-Newton sequence {x^}. 
First, note that the first equation in @ together with (|12p . imply that the sequence {x/c} satisfies 

x k +i = G F (x k ), fe = 0,l, .... (13) 

which is indeed an equivalent definition of this sequence. 

Corollary 11. The sequence {x^} is well defined, is contained in B(x*,r) and converges to the 
point x* and it holds that 

lim H|xfc + i - x*||/||xfc - x*||l = 0. (14) 
If, additionally, h3 holds, then the sequences {x^} and {t^} satisfy 

\\x k +i ~x4< [t k +i/t p k +l ] \\x k - x*|| p+1 < [ti/t p +1 ] \\x k - x4 P+1 , k = 0, 1, . . . . (15) 



Consequently, for k > 0, 

«^/s * 1 1 ^ 



to[h/t ] k , if p=0; 

t [h/to]« p+1)k - 1)/p , if P^O. 



Proof. Since xq £ B{x*, r)/{x*}, i.e., < ||xo — x*|| < r, and r < v, combining (fT3j) . the inclusion 
in Lemma El Lemma [5] with an induction argument, we conclude that {x k } is well defined and 
remains in B(x*,r). 

We are going to prove that {xk} converges to x*. Since \\xk — x*|| < r < p, for & = 0, 1, . . . , we 
obtain from (|13p . Lemma [7] and Proposition [3j that 

< ||aifc + i - x*|| = \\G F (x k ) — £c*]| < - x *\\) < \\ x k -x*\\, k = 0,1, ... . (16) 

So, {||xfc— is bound and strictly decreasing and therefore converges. Let I* = \\m k 

— >oo \\ x k || • 

Since {||a;fc— £c*||} rests in (0, p) and is strictly decreasing, we have < < p. Thus, taking the limit 
in (fTBj) with t converging to and using the continuity of gj in [0, p), we obtain that < i* = gf(i*). 
But, if £* / then Proposition [3] implies gf(£*) < £*, hence I* = 0. Therefore, the convergence 

X fa r X ^ IS proved. 

In order to prove the equality in (HU), note that equation (fT6j) implies 



[\\x k+1 - x*\\/\\x k - x*||] < [gf{\\x k - x*\\)/\\x k - a;* ||] , = 0, 1, 

Since lirm : _ ) . 00 — s*|| =0 the desired inequality follows from first statement in Proposition [3j 

Now we show (fT5|h First, by induction we prove that the sequences {x k } and {t k } defined, 
respectively, in (fT3l) and ([9]) satisfy 

||aifc - < t k , k = 0, 1, (17) 

Because to = ll^o — £*||> the above inequality holds for A; = 0. Now, assume that \\x k — sc*|| < t k . 
Using (fT3j) . Lemma El the induction assumption and ([9]) we obtain that 

\\x k+ i - x*|| = ||Gir(a:jfc) - x*|| < ||x fc - < = ffc+i, 

and the proof by induction is complete. Therefore, it easily seen that the first inequality in (|15p 
follows by combining (|13p . (|17p . Lemma [8] and ((9]). The second inequality in (|15p is immediate, 
due to the fact that the sequence is strictly decreasing. To prove the last part of the 

corollary, combine (115p followed by some algebraic manipulation. □ 



The proof of Theorem Q] follows from Corollary [H the Lemmas [9] and [10] and Corollary [TTJ 

3 Special Cases 

In this section, we present some special cases of Theorem [TJ 
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3.1 Convergence results under Holder-like and Smale conditions 

In this section we present the convergence theorems for Gauss-Newton method under a Holder-like 
condition, see [6{ 110]. in particular a Lipschitz condition, and a Smale condition, cf. [14J. 

Theorem 12. Let X and Y be Hilbert spaces, O C X be an open set and F : 0, — > Y be a continuously 
differentiable function such that F' has a closed image in Q. Let x* 6 f2, R > and (3 := Hi^x*^ ||, 
k := sup{t 6 [0, R) : B(x*,t) C 0} . Suppose that = ; F'(x*) is injective and there exists a 

constant K > and < p < 1 suc/i f/iai 

||F'(x)-F'(x*+r(x-a;*))|| < K(l - r p )||x - x*f, j;e%/t) tG[0,1]. 

Let 

r = min{ K , [(p + l)/((2p + l)/3K)] 1/p }. 

Then, i/ie sequences with starting point xq 6 B(x*, r)/{x*} and to = \\xq — respectively, 

/3Kpt p+1 

%k+i = x k - F'(x k ) 1 F(x k ), t k+ i = - — k or^.p V fc = 0,l,..., 

are iweZZ defined; {t k } is strictly decreasing, is contained in (0, r) and converges to 0. Furthermore, 
{xk} is contained in B(x*,r), converges to the point x*, which is the unique zero of F in B(x*, [(p + 

i)/m)Y ,p ), 



i _ ii <- p k p H _ iip+i < p k p H _ iip+i 

|JA + I ■' ■"- (p + l)[l-PKtl] llXk X * 11 S (p+l)[l-f3K\\x -x4P] Pl ' " ' 



for all k = 0,1, ... , and 



* 1 1 ^ 



(p+l)[l-/3i^||x -x*||P] 



|xq ^* II ? ^ — 0,1,.... 



Moreover, if [(p + l)/((2p + l)/^)] 1 ^ < k, then r = [(p + l)/((2p + l^iT)] 1 ^ is the best possible 
convergence radius. 

Proof. It is immediate to prove that F, x* and / : [0, k) -»• M, defined by /(t) = Kt p+1 /(p+ 1) - i, 
satisfy the inequality (|3j) and the conditions hi, h2 and h3 in Theorem [TJ In this case, it is easily 
seen that p and v, as defined in Theorem [IJ satisfy 

p=[(p+ l)/((2p + l)/?^)] 1 ^ < z, = [l/^]Vf , 

and, as a consequence, r = min{K, [(p + l)/((2p + l)f3K)\ l / p }. Moreover, \j3(pf'(p) — /(p))]/[p(l — 
PU'{P) + 1))] = 1, /(0) = /([(P + l)//3i^] 1/p ) = and fi{f{t)/t + 1) < 1 for all t € (0, [(p + 
1) / {j3K)\ l / p ). Therefore, the result follows invoking TheoremQ] □ 
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Remark 3. Whenp = 1 in above the Theorem, we obtain the convergence of Gauss-Newton method 
for solving overdetermined nonlinear systems of equations under a Lipschitz condition, obtained by 
Ferreira et al. in Corollary 19 of fBjj. 

Below, we present a theorem correspondent to Theorem [1] under Smale's condition, which has 
first appeared in Dedieu and Shub [4], see also Corollary 23 of [8]. 



Theorem 13. Let X and Y be Hilbert spaces, f2 C X be an open set and F : £1 
function, such that F' has a closed image in O. Let x* G f2, R > and f3 := 
sup{i G [0, R) : B(x*,t) C £1} . Suppose that F(x*) = 0, F'(x*) is infective and 



Y an analytic 



\F'(x*) 
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sup 

n>l 



F( n \x*) 



l/(n-l) 



< +00. 



Let 



r : = mm 



. {«, (2 + 3/3 - y / /5(8 + 9/3))/(2 7 (l + /3)) } . 
Then, the sequences with starting point xq G B(x*, r)/{x*} and to = \\xq — x*\\, respectively, 



x k+1 = x k - F'(x k ) 1 F(x k ), t k+ i 



(l + /3)(l- 7 t fc ) 2 -/3' 



k = 0,1,... 



are well defined; {t k } is strictly decreasing, is contained in (0, r) and converges to 0. Further- 
more, {x k } is contained in B(x*,r), converges to the point x*, which is the unique zero of F in 
B(x*, 1/(7(1 +/3))) and there hold: 



(1 - j\\xq - X* 



/3 7 (2||x - x*\\ - j\\x Q - x*|| 2 ) 



fc = 0, 1, 



Moreover, if (2 + 3/3 - ^(8 + 9/3))/(2 7 (l + /3)) < « 3 then r = ((2 + 3/3 - ^(8 + 9/3))/(2 7 (l + /3)) 
is i/ie fresi possible convergence radius. 

Proof. Note that the real function, / : [0, 1/7) — > M, defined by f(t) = t/(l — 7 i) — 2t is a majorant 
function for the function F on B(x*, l/ 7 ). Hence, as / has a convex derivative, the proof follows 
the same pattern as outlined in Theorem 20 of [8]. □ 



3.2 Convergence result under generalized Lipschitz condition 

In this section, we present a local convergence theorem for the Gauss-Newton method under a 
generalized Lipschitz condition due to X.Wang (see \10\ |16j). It is worth pointing out, that the 
result in this section does not assume that the function which defines the generalized Lipschitz 
condition is nondecreasing. 
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Theorem 14. Let X and Y be Hilbert spaces, C X be an open set and F : 0, — > Y be a continuously 
differentiable function such that F' has a closed image in f2. Let x* G fi, R > and /3 := ||F'(x*)t||, 
k := sup{i G [0,i?) : B(x*,t) C 11} . Suppose that -F(x*) = 0, -F^x*) is injective and there exists a 
positive integrable function L : [0, i?) — >■ R smc/i £/ia£ 



(F'Oe) -F'(x* +t(x-x*))|| < / L(u)du, 

J r\\x— x, II 



(18) 



for all t G [0, 1], x G B(x*, re). Let positive constants 

v := sup jt G [0, i?) : 1 - J L(u)du > j , 

p := sup |t G (0, <5) : /3 J L{u)udu j t ^1 - f3 J L(u)du^ < 1, t G (0, <5)j , f = min{re, p}. 

be given. Then, the sequences with starting point xq G B(x*, r)/{x*} and to = ll^o — %*\\> respec- 
tively, 

= x fc - F'(x k y l F(x k ), t k+1 = /3J L(u)udu j - j3 J L(u)duj , fe = 0, 1, . . . , 

are we// defined, {t k } is strictly decreasing, is contained in (0, f) and converges to 0. Furthermore, 
{x k } is contained in B(x*,f), converges to x* which is the unique zero of F in B(x*,a), where 

a := sup |t G (0, re) : (3 J L(u)(t - u)du - t < j . 

and it holds: lim^oo t k+ \/t k = and \\m k ->oo\\\xk+i — ^*||/||^fe — = 0. Moreover, if 



f3 j L(u)udUj 



p ( 1 - j L(u)du 



and p < k, then r = p is the best possible convergence radius. 
If, additionally, given < p < 1 

h) the function (0, v) 3 1 1-> t l ~ p L{t) is strictly increasing, 

\\x k+ i — ;c* || < ||x fc - x*|| p+1 < [tiAo +1 ] - ^*|| p+1 , 

Consequently, for k > 0, 



k = 0,l,.... (19) 



\%k — 



^0 [*lAo] fc ; 



to[tiAo] ((p+1) 1)/p , */ P^O. 



12 



Proof. Let / : [0, k) — > R be a differentiable function denned by 

f(t)= f L(u)(t - u)du - t. (20) 
J o 

Note that the derivative of the function / is given by 

f'(t)= f L(u)du-l. 
Jo 

Since L is integrable, /' is continuous (in fact /' is absolutely continuous). So, it is easy to see 
that (|18p becomes ([3]) with /' = /'. Moreover, since L is positive, the function f = f satisfies the 
conditions hi and h2 in Theorem [TJ Direct algebraic manipulation yields 



[*/'(*) " /(*)] /t P+1 



t 

.p+i 



L(u)udu 



o 



It" 



If assumption h holds, then Lemma 2.2 of [T7j implies that the second term of the above equation 
is nondecreasing in (0,v). Hence, h3 in Theorem [1] with / = /, also holds. Therefore, the result 
follows from Theorem [JJ with f = f, u = u, p = p, r = f and a = a. □ 

Remark 4. If the positive integrable function L : [0, R) — )■ M is nondecreasing, then the strictly 
increasing function f : [0, R) — > R, defined by 



f'{t) = [ L(u)du - 1, 
J o 



is convex. Hence, as seen in Remark^ the sequence generated by Gauss-Newton method converges 
with quadratic rate. Moreover, in this case it is not hard to prove that the inequalities ([3]) and (|18j) 
are equivalent. However, if f is strictly increasing and non necessary convex then the inequali- 
ties (|3|) and (|18p are not equivalent. Because there exists strictly increasing, continous functions, 
with derivative zero almost everywhere, which are not absolutely continuous, i.e., they can not be 
represented by an integral, see examples in fTSt U2 



4 Final remarks 

The inexact Gauss-Newton like methods for solving (pQ) are described as follows: Given an initial 
point xq £ Q, define 

x k+1 = x k + S k , B(x k )S k = -F'{x k )*F{x k ) + r k , k = 0, 1, . . . , 

where B{x k ) is a suitable invertible approximation of the derivative, F'(x k )*F'(x k ), the residual 
tolerance, r k , and the preconditioning invertible matrix, P k , for the linear system defining the S^th 
step, satisfying 

\\Pkr k \\<e k \\P k F'(x k )*F(x k )\\, 
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for suitable forcing number 9^. It would be interesting study these methods under a majorant 
condition, without the convexity assumption on the derivative of the majorant function. This 
analysis will be carried out in the future. 
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